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[Claim 1] In the o - x _ s stenography receivmg set which gong-ates S-dimersiensi sonography based on the 
noags mtaooatioe transmitted bo-;-: the sending set A receiving means to receive the signs; with which the additions! 

* for generating ^ - „ « > ■> ■• image infc-rmsstlDo 3 me b-dimensiorm: scenography which > 
tramsc-sited from said sanding set „ erioodsd. A decryption means to decrypt sa;d two-dimensional image 
intonmation and said additional in for motion - the signs; received by this recsiwng means, respectively- The o 
dimensional soenography imaeivmg so;: characterized by providing a gen oration meawa on generate the Iwemwrnsiooa; 
cane ; information, using said two-dinae ana n&gi format , 

[Cisirn 3] The omfsrmmnonai sogm:.ag:o:phy receiving set according to claim 2 omwantermed by having a means to 
changa said depth valoe baaed cm o value opacified as an observer on tbs basis of >-, ^ death value, 
[Cdatm 4j In the cwflmenaional scanogranhy receiving set. which generates m-dlmanslooal sosnography based on the 
lavage information transmrmed fro an a sanding sat The ■> . a Inmgs Information which is 3 t h from 

said sending sat ana whiah was divided tor every - e A receiving means to rsca:ve the signal with which e 

s i Infarrnattcm which shews the physical relationship between aacb element, and tba depth value of each 
element were encoded, A decryption means ta aecrynt said >" > i- image information, positional 

i <. t t and sss 

v tba .^--dimensional scenography using parailas Information, cased on sain two-dimensional image 

information for a vary ai a roe nr. decrypted with this decryption mesas., tba positional informstion oefween each 
Pie ? — v 1 the depi rslue ft svem am - 

Changs said depth onion based an tba value speoiflso as an observer on tba basis of said depth value renewed with 

judging tbs three-dimension configuration of an image from a two-dimensiona: video Signal as am; treatment and 
n m , ■> e-dlmem;lonsl scepography. and said - , i. - - video signal A ending means to encode- the 
abditio nation ganeratad i: - ' savlt th< 

signal which eneodsd a twowshvmn.a:ona.i v:dao Signal and additional information With this coding moans to said 
receiving set. Said receiving set A cs cry mm a maaas to decrypt sam two-dimensional video signsi and addibbnsi 
InAiroiatioo respsativaly fra:-; the signal rsceived votb s rsoeiving means to receive tba signal transmitted from said 
senemg s .m, «nd fh:s raaeiv;ng S3sans. The aoiio visas! systen; eharacterisad by consisting of a tot means to 
generate the 3-dimensianai soenogmphy using oaraiiax information, based on said two-dirnansionoi video signs! and 
additiaoa; Information which were deci-yptod vnth this decryption means. 

[Gblm ~ * the solid visual systam which oofssists of a sendayg sat which transmits imaga mforinntinm and a 
em ^ ^ v. no f - ^ ^ c ' ' ' N > 

scsnognaphy said sanding sot vVhiie speeding the twc-olmensional video signal oar evsry alamort which divided the 
Avomlimonsional video .Signal for every slea^nnt according to the contents of the Image as prat mamma at. and was 



moth v 



to generate a ■< " soanagraDhy osing pateilax information, based en the two-dlmsnslonsl video s 
' 1 ' t ^ f 5 m v - s „ ; 



p >ooc 0786 ms 

depth vslas for every element 
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[Detailed Description of the irvsi-tloo: 
[0001] 

. k ^ j the - 5hy receivm* sob an< 

system which generabs S-oimoosionai sonography based on additions; Information and rwo-dimansiooa! video 
.signals, such as depth infer coat loo extracted 0-om the twe-diroensiooa! video signal. 
[0002] 

Dssorigtion oft e] Convention eloorrent <: sp ay 

(solid display'} progresses, there are few amounts o? the nonconvsrercla! sort.wcre for ID-dimensional seonogrophy, 
and* is to c w > 3-dirr nsiona sesnog 

i 50 ov; otv- n * -v;;;: ; -> , 0 % d, • , ^ , ; s 

transmitting a two-dimensional video signs!, a sending sob 100! encodes a two-dimsnsiens; video signs! with coding 
eoo:prr:enf 1003, sod :s transmitted. After a receiving sot :003 receives < signal encoded from this sanding set 
100; and decrypts a two-dimensional video signs: with cscryot:an eoolprrmnt 1004. it generates two parallax vidso 

m , m « g a < 

[0004: As on approach of generating 3-dimer:siona: sceoegraphy. ft assumes for example that it is what always has 

I U d o s, 1 „ 

o seen to the front. 

"J%3 ' o - fs v jches sn tNs 

p * ev<? > e v ^ eon b<= - 
field *****=! carrying - H»k > - ova be psrosived to ths front 

[OOOSj ifesearoh which current and • above onage processing tscrnloues accomplish development, sod are not 
concerned with go anio^oilon end a still picture, cat pressmen a thres-mliommsior; configuration, from « two- 
-r image Is sore bnskiy. Or the otror hard, standsrOlsation ' ~ Is - ahpoi coding of on Image. 

The configuration Is shown In drswsng ,.1.1, . First, a tvm-- dimensional image as shows In drawing,,:! (a) is Inputted into 
- sanding set \ in an arithmetic unit 10:2, as shown In dwawngjy (b; - , while olsosssi'sdilng on image Into a 
opsTSJonaol. - - crossing each • ■> -\ n w:th coding opsion^snt 10 ; 3, the Inforrryatlcn on ths ndysioai relationship 

e<,ch e"cooso j 

plx.nai Is hi sr sosaosted for every oiesvso:. by she osor.dtis^ser 10:8. biaon ssp.w-ateo eisment is 'boor/sted by 

oo;noido:':Oo. As show;; in c:rawing J2 (ad the dooryptsh Signal is eo-ripounded based on the Inforrnatdjr; so physios! 

rsiatisnsblo In the sw bhebs section 101 S. sod is out-putted as a sobisot-ooov ioisgs son same liyssg®. 

[0007! 

iP:-sd!sn-:(o[ to be Solved by the Invention: i-ioweyen the oatpat of the equipment of above-mentioned drawing J J Is 
s two-dsTiSOsiona! dnago to the last. Then, whan a 3-di-vinsions: scsnagraphy i-o;;alvtno sot sands to perform 
eltogotiior processing whobo oranges a twp-o:ooens!ons; iossge into the 3D sceiiography which das rosi nature i-noro. 
there is a faoit that a S-din-seosiona! sceoograniiy repeiv;r:g <. serves as a :arge sons or it bepoinos arvt dbb:c:dt to 
s ^ ughjsut on tiro* 

[CKXibi Then, this invention can lower tha post of a - - soer;og^sohy rooaiving set. aod eirns at * >. 

ths S-disTsensionai scenogrephy racsiving sot and sold; voojai systoo- whioh cor; prooess the roc&lved imago 
\ „ < ;an gsnsrate 3-dijri to ^al oCt '< v f -< ^> 

v t f*^rtc foao Tht 1 «iE i ->v f ' •P'jfse nd i e<"" p N * 

ocericgrophy receiving set of this invention In what generates 3-dii-nersiooa! ssesog>-aphy hosed on the image 
irvFoiorratvon traosoiirtsc from the sanding set A receiving means to receive ths signal with which the additional 
intorrr.atiu" f V ge s v the i:yvc~di-nsin;bona! xr-.&sfi "b'-n pt ^n sob -i 1 -?: 'i-r.-tr-tx'^sr-.rA soenography which are 
trans mitt.eC from sa;d sending set was encoded, It consfitotos IVory s generation oceans to generate the 3" 
diiTsnsiopai soancgrashy oesop; parallax information, using a o'g-Cfyption means to decrypt ss:d two-orTiensionai 
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tvTOm^ms.nsiomal Image information, with which it was dscrysstsd by this decryption means and said sddmomd 
snfcsrms&n. 

; ma ^ - - r ^ v ; c ^ - >- ~ 

two as slooai Irr sags t \ n&i an from toe rece s % soi . \ ss b om. b 1 e shorn - 
r - < means since ■> - < imago information and additional information < sent from a sending set 

can be m-m >--n ; -- Sigmh proc-eooiny in a receiving set can am simsii-fsed greatly. 

to a drawing. Drawing j ;s a block diagram for explaining the gestalt of implementation of the 1st of this invention. 
5 h;s s - , system consists of a -s 'i set "-m e - — „ soenogrsphy ir o c set; wmch transmits image 
;mm-nvihcm, and a reesivmg set bO-dirnensionsI s-cenography receiving sot; winch receives oho image information 
transmitted from this sending set, end displays that image. For example, as a sending set. they ere the sending sot In 
the broadcasting station of television, e video camera, or s video taps recorder (VTR). As e renewing set which 
receives and n o < the image Information transmitted from such a sending set, there are torn* dimensional display 

.. 0 - t t SJ3 SV 

[001?.] As shewn in drawing J . en arithmetic wet 1 02, coding equipment 103. and multiplexer 1 04 oonstitote the 

0.50 lb; h;rst. she two -mmonsional video Signs; vvhioh snonld bs wwnsmitfed to the arithmetic emit ICS w the sending 

dlrnansiomai seeoography n. performed, and additional mfor-matmn effective in gemmation of ihmwminsiooal 
sonography Is computed. A.-s useful wformatlom the three-dimemsion oonligijriihon directly presumed from the two- 
dimensional image is in generator: of d-dimensiona; soenography, and bus snows with the depth value over seed 

[0014] There io how a three-nil mensem configuration :s e>mwm:-tsd [ mnoh ] worn a two-dirnensiooal image In the field 
of currant and a computer vision, and research ;s done, Since the two-dimensional video signal adneh changes m she 
direction of a time-axis Is inputted into the a w ^ 1 - i arithmetic unit ;02 of <- gesl.alt of thin 1st operation, 



as & <m v. m * ^cs- jn 

- • ': j stmn of a * sxti g 1ms distanc* rno-dime c 

v t v v as a 

aramicter when r s sralle.x n • * tier, of an element m beiwer 



elements, and the above-mentlonec parameter relates aaoh other to each other, Therefore, ah the above-mentioned 
parameters will correspond bssldeo a depth value es addinooei information effective in bwhmomjmna! soenography 
ganerstlon. That n;. the oarametm' of a three-dimension element Indispensable In order to gonorsto o-dlmesisdoosi 

^ % of this 1 st 

wt ;* o > o « - - N , - - , ; v ^ , ^ - ~ - »j ^ i« <p <■■'■, aw,s 

and the high antiwaatie umt of eapaoity is used at a transmitting side compared with a roee;v|;-:g olds. For this 
reason, generation of c-dimensional soenography w th a more high precision Is attained. There-fore, although it Is 
desirable to presumption of the tlnme-dnnension configuration mom a two- dimensional image hp- me- operation winch 
t^ v c - N a- 

m m -> s depth is set lie ' and it is good for It also considering h as additional ;nhormat!oo, 

[00 IS' I hloracve c s erased with f he ; arifhmei lc >ded tvlth 

coding eeulpsnent 103 with two- dimensional image information. These two encoded signals are multiptesed with 
mohiplexer 104. end are transmitted to a receiving sot 105 mom a sending sei; ;0h 

two-uhiwerisionai video e I g.mi I arid er: adiJifionai information signal by the demultiplexer 106 of a receiving set 105. 

information, Dr mlm.Z. (a) As .shown in ~ (d), the two-dimensional video signal 1 1 1 inputted sm.o a sending set 101 
end the depth value (additional information) id for every pirel oompmsd from I his tvvo-dlmeoslonai video signal 11 1 

. , -tede of a 

screen, en observers observation distance, and the distance between both eyes Into which location of a pamtlax 
" a - - 's, a dimens < .^a^ . a gw 

oatio , s two-dliTiensic ai imag 
pi:x c3ti< i tyes, and th cat fo ** " ^-^ *• g ^g ^ 1 a pso ^ s t d georne&y Is 

asked for a location. Moreover, in case a , ^ ^ " image is changed into a pargilisx image. It is ' ~- s to 
gsnsrete the m<«; wi'-oh coos -at e.dm: m a two-dimensional mage. In this case V e-e-nole, it :-^e>ooiaf«s are 
generates from a contiguity plxal. 
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0021 j £ st - so -. >} - 5 o. p g ad fron m-d-mens 

a rs ng sid gc,.^ - f smg ?sc b 

c parallax image s gsoensted by i * e, r » >,m - 
e ^ - ~ - 

[0022.1 Thereby, generation of S-dlmensional ameeogrsnhy with s high oi-ecisloo in a roernvrng set is attains;; on reai 
time. Moreover, since a dsnth venue is sent as additional Information of the usual twm-dimmnslona; video signal, 
television which can display only a + , - - ^ image nan maintain p n -fv 

01)023; Nest, d-awing 4 ,s a block diagram tor s.xpialmag the gsstalt of impimnentatioo of the find of this invention. 
First, the fwwmA-sm. ■ :,: video signal which shockd bo transmitted to the arithmetic unit 202 In the sending set 201 
of a i - - 1 - - tten i e;ud 202. pa eg-etcm of im 

video signal w carried not, and fleid division of the screen of an image is carried oat for even/ smmont The 

teehnlqpe is Introduced. Moreover, m an arithmetic unit 202 : processing which presumes the depth for every 
element is pa .'formed fs coincidence. 

> * <.Ov iT Ik. * " ( ^ 

processing sections a~e arranged - and it processes to jemsecslflor: , shown In drawing 4 , If < - process 
two or cmre elements in the one coding processing section ssewshtally, 
j < , - , > - - % » 

idem* ; element. The s< - 3j ,( S i < mat fee 

Scef 5 - - e r ding 

[002ej Moreavsr, coding secernent 203 also encodes the depth vales for every element as additions! Information. 

An example of this coding format is mown in drawingjs , An shown in dmwing .5 . en index (index) aisc stores the 

value wisch shows the din length of a signal dy the identification nods which snows that the signal Is the information 

>r - - v 

cv ~ - * ~ a a s < 

other then positional information; - arrangement of the three -dimension space of each eieroenf can he specified 

^ N % 5 - - ~ < ^ ; t or 

language, 

1.032 A And after icAtieiswng each signal encoded - coding epniprrmot \ ) vote multiplexer 204 and changing t 

iota n transmission format, it is tra n s miff ad from transmission equipment 201 Aransm;ss:on}, 

[0328] Tire demnltiole.mr 20S in a receiving ear 205 receives, and this rrarcmiraed signal is separated for each 



' v t processes a N ' ^ s m s but as long as It ce:': process this processing vstAc real cms. it n 

„ <i - - - 

epeiprneiri's 20S peso ig after treatment recon-ed > s 

e - s5 . - , ' <= - t a - n \i 

[0031] Draw e Is a cceoepteai diagram at vhe time o? eslng the esprh value for every siemsof es additional 
information. That is. to the someot'oopv image 221 nf a two -cis^e-s ona; "wage, as shown in draw ing 6 Ca). as shown 
- ! oflMiiifS.O 0D - (ciif. it divides into the image 222 of the background in the subject-copy image 22'h the image 22b 
sf a honse. a;nd ; smage 224 of a has As depth information on each of tins divided siemeot and each etemsnt, a 
depth valna is; delscmlnen ft-sn: the hank m order of the Image 222 of a hackgi'oued, the image 223 of a hemsm and 
the Image 224 of a ban. And a soineot-oopy Image encodes thp physhml relationship so fm- erase on en each of these 

ir-ii«' 3 video signal encoded end transmitted, the physical relacmrship Information betwese each element, 

shown In ^ ^ ^ " That ls T in order to take ont a sferio effect, when a photographic. snPgm- ln : «ge Is rotated or 
mcved and a stereoscopic msds! is sreated, tlm crlg-nal two-dlmeriS;sna! screen nrodsct end the area for a 
stereoscopic mode: are net necessarily in agreement. For fins reason, the non-pictore area which does net have a 

image 222 cf a background, and the image 233 of a nonce to the suhnect-copy Image 231 with the sending per. and a 
psrailsr image is generated according to the image and depth vales of each of that element. Then, as shown m 

' a m e . a - o « area witnopt « p:x«i may occur, I this case, ss shown in S£8wis£2 (ti). it miorpoistes fey 

expanding the Image 233 of a house by space shaft orientations, .Moreover, it is also possible to interpolate a field 
without a pixel from a contiguity pixel 

[0034 j Drawing J. ;s a block diagram for explaining the gsstaii of impismemmtlon of the 3rd of fins ievenhen. In 
sdditlo Prto the exc a - •> f 
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opersllo s a, ;s-.v;n£ 8 . in s rscs ae KS t;a»> -nasgs gensra n a pment 302 sr.erste 3 
<s<t?p< ^ <^ \ 

arvar adjusts. It enables t « - snograp 

a asar can adjust psrsiij orrr, i pan ad ; 

1.003S] wrgngngj " l« drawing for explaining an example of ps : -&;l3x >■ - e - A;s shown in drawmgS - the 
depth vebe ssoifssd as a rscstving sst 301 by prstrsst of the -nettc m 

1,0038] And as show;: in rf-^vlng.S (b). whsu a oner adjusts tea datum level of dspfn. a nser Inputs the adjustment 

depth value 312. sod generates s parallax imegs. The depth value specified by ths sending sat 105 nan be changed 
Py tms aocormng to ths admstrnem value sf ths datum ievei of the depth which an observer inputs, the image 
generaosd oas Pn changed into the image whins is visible to ton snags which Is visipie to ths whofe est back,, or this 

1.0037] rgoreovsr. noise a user adjusts the amount of ospsh. a nssr inputs the srsoses of sdcsitroeiits of ths amoonh 
■>* , vt> w t t < < r -i- 

receiving set 3(1; makes the depth value 312 hsctsate according to ths amount of edmstmeuts. Is cPesged mt;s the 
depth value 3U. ana generates a parallax image. The ursage whins changes ami generates Py this the depth value 
specmed by she sanding sat asosrdlna; to ths amount of sdlsmrsents en the, aniosnt of depth which an observer 
Inputs sen be changed sets the large lusgge of depth perception, or ths small image of depth perception, arid ths 3- 
J ~ ' ' : . m . ^ m » „ ^ x - - a v«r ■-cm bs nf%rsd 

lOfgloh aPeve-nresti'osed tnn 1 •- as ths gestalt of sash 3rd oeerauoo aspbuoed s 3-mlmsnslonawscenogre.phy 
e " - 3 " " w < -c f . t ^w 

o \ <" - image, era depth value of each e;estsr:t, when generating g-dlrsersismP m ' - two- 

dimensional image, and transoms if to a 3-dlmensicnalmmenogmpcy receiving set ;n ths processing which gessrst&s 
3 1" scenegraohy from e two~dlmemnOiisl image an a signal wench ensorSec tno additional information 

aoons'sd vvdh this prep-eotment. and a two-dimensional fnags. A 3"d;mensmmh asenogmghy receiving sst reosivss 
the transported signal, decrypts a two-dimensional image and ases.isnai Inforsiaflon. respectively, and generates the 
3-d;moPslsms scenegraphy using paraiiax mfermat;on based on the two-dimensions! Image and i i 

m e^s og w*tc>i --jxti-acts s>y • - s acci >. o- 8 f Son w Sv cn «s D-eSuP^t on of a 
- - ; i - i - ;an 3«s 

in case d-dirsesslsna: scenegraphy generates based on additional Information, ssoh as a depth value aoossred by the 
N ~ - ^m v 

[0041] 

[Effeof of ths Invention] As siphoned si fsh detaii above, according to this Invention, rhe cost of a 3-dsmensiona: 
so a : va granny reoolvlng set can be iowerse, ths rsceived linage sn : orn : 3t:on can Pe processed or; roai time and 3- 
val s -s :hy can bs ganarotsc 



fTramnarmr; done.] 
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LDir<hhDh:hii ^ t system oonflgnrahof; Fig, oonosrniog the gesosh of of the 1st of this invention. 

L^reMpg 2j The exsharratory view for e.rgfsining the concept of the oerstedr of instsnvsritetion of r:he ist of this 

ip?;a^;is::g 3j Drawing showing toe depth to perceive sod ths gsomstrio reiirdori of the parallax Image fo generate. 
iOS>iiCS.tli ^ ; ' :S: ovaree; go edge rat ion Fog, concerning the geatair of Ingtenwofstion of the hod of this iovontioo, 
y : oh^d?l;JU Dfawi'-g showing the transmission fcmmst at ths tino; of making 3 o'eoth vwae into adomoom informa;;;, 

[Drawing S] Drawing for sypioioing rhe concept of too gestah: of the 2nd opsmtion. 

iQtStyM §1 Drawing showing the conligiiratiori of the , s , system concerning the gs stair, of the , operati 

. " ^ " sxpla;mirg the aoDmtroent ssprosoh of the osefh of an image. 
K?.!iSMSSi5l Drawing showing ths strooDire of a system which e a ' o-~ e stenography from ths 
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103 (£03) Coding eouipa-ent 
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Km Dhn 301} Receiving sot 
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